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Independent  analyses  using  Fisher  information,  optimal  filtering,  and  information  theory  show  that  matched 
filtering  images  with  hypothetical  patterns  in  the  logarithmic  domain  provides  an  optimal  method  for  pattern 
recognition  in  the  presence  of  signal-dependent  noise  arising  from  complex  Gaussian  fluctuations  in  the 
received  fields.  This  provides  a  mathematical  justification  for  the  use  of  logarithmic  units  (i.e.,  decibels)  in  a 
variety  of  engineering  applications. 


The  stochastic  behavior  of  optical,  radar,  and  acous¬ 
tic  fields  received  from  both  fluctuating  sources 
and  scatterers  can  often  be  well  approximated 
with  circular  complex  Gaussian  random  (CCGR) 
variables.1-4  Averaged  intensity  from  a  CCGR 
field  has  a  standard  deviation  proportional  to  the 
mean.1  Therefore  intensity  images  derived  from 
CCGR  fields  have  signal-dependent  noise.  Taking  the 
logarithm  of  such  intensity  images  homomorphically 
transforms5  the  signal-dependent  noise  into  additive 
signal-independent  noise.6  It  is  shown  that  matched 
filtering  such  images  with  hypothetical  patterns  in 
the  logarithmic  domain  provides  an  optimal  method 
for  pattern  recognition  according  to  the  independent 
perspectives  offered  by  minimum  variance  unbiased 
estimation  with  Fisher  information,  optimal  filtering, 
and  information  theory. 

Let  the  vector  W  contain  the  independent  aver¬ 
aged  intensity  measurements  Wk  assigned  to  k  = 
1,  2,  3  . . . ,  N  pixels  in  an  image.  Let  the  vector  a  con¬ 
tain  the  parameters  a;  to  be  estimated  from  the  im¬ 
age  W  for  i  =  1,  2,  3  . . . ,  Na.  Assuming  that  the  W/t 
are  measured  from  CCGR  fields,  the  conditional  proba¬ 
bility  distribution  for  image  W  given  parameter  vector 
a  is  the  product  of  gamma  distributions1: 
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where  oyf(a)  =  07, ( a )/ Iref .  The  expectation  value 
of  Lk  is  Infernal]  +  ip([ik)  ~  In  fik,  and  the 
variance  is  £(2,  /jl/,).  Here  i/i(fik)  is  Euler’s  psi 
function7  and  £(2,  /x /, )  is  Riemann’s  zeta  func¬ 
tion.'  For  example,  ^(2,  1)  =  tt2/6,  and  in  the 
limit  nk  »  1,  (Lk)  ~  Infer/, (a)]  and  the  variance  is 
£(2,  j±k)  ~  1  / Hk-  The  exponential-gamma  distribu¬ 
tion  for  Lk  is  denoted  I '  Cj((Lk),  fik). 

According  to  estimation  theory,8,9  the  Cramer-Rao 
lower  bound8,9  (CRLB)  E\(d,  -  a,)2]  a  [J-1],;,;  limits 
the  minimum  mean-square  estimation  error  for  any 
unbiased  estimate  d,  of  the  true  parameter  value 
at  from  measurements  Y,  where  J  is  the  Fisher 
information  matrix8,9  with  elements 
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The  Fisher  information  matrices  for  image  W  and  its 
log  transform  L  are  identical  and  found  to  be  equal  to 
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For  pixel  k,  the  mean  intensity  (Wk)  =  crk( a)  explic¬ 
itly  depends  on  the  parameters  a  to  be  estimated, 
and  the  quantity  /j,k  is  the  number  of  coherence  cells 
in  the  intensity  average.1  This  number  is  equal  to 
the  signal-to-noise  ratio  (SNR)  (Wk)2/((W2)  —  (Wk)2), 
which  is  approximately  equal  to  the  time -bandwidth 
product  of  the  received  field  for  the  given  pixel  (or 
the  number  of  image-plane  speckles  spatially  aver¬ 
aged1,6).  The  gamma  distribution  for  Wk  is  denoted 
(g((Wk),  lik)-  The  log- transformed  image  L  is  defined 
by  Lk  =  \n(Wk/Irei),  where  7ref  is  the  reference  inten¬ 
sity.  This  transformed  image  obeys  the  conditional 
distribution6 


where  07, (a)  can  be  replaced  by  01(a)  =  oi(a)//ref  to 
reference  the  logarithmic  measure  to  physical  units 
without  altering  the  Fisher  information.  Some  useful 
applications  of  Eq.  (4)  are  given  in  Ref.  4.  The  Fisher 
information  matrix  of  Eq.  (4)  may  equivalently  be 
written  as 
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Equation  (5)  shows  that  the  CRLB  can  be  computed 
directly  from  the  expectation  value  of  logarithmic  in¬ 
tensity  measures.  It  is  significant  because  it  shows 
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that  Fisher  information  is  contained  in  (1)  the  varia¬ 
tion  of  the  expectation  value  of  a  logarithmic  measure 
of  image  intensity  with  respect  to  the  parameters  to  be 
estimated  and  (2)  the  number  of  coherence  cells  aver¬ 
aged  for  each  pixel.  It  is  interesting  that  the  Fisher 
information  matrix  can  be  obtained  directly  from  the 
Gaussian  form  of  P(L|a)  or  P(W|a)  in  the  asymptotic 
limit  fjLjj.  »  1  because  a  is  not  a  function  of  /xi>.4  This 
is  consistent  with  Fisher’s  use  of  the  central  limit  the¬ 
orem  in  his  initial  derivation10  of  what  became  known 
as  Fisher  information. 

The  efficiency  of  logarithmic  measures  is  particu¬ 
larly  evident  in  the  estimation  of  a  single  param¬ 
eter  a  from  a  single  measurement  L.  Here  the 
minimum  estimation  error  is  {E[(a  —  a)2]}1/2  = 
[,/7Z|(d(L)/da)|]-1.  The  optimal  resolution  of  the 
parameter  is  inversely  proportional  to  the  param¬ 
eter’s  slope  magnitude  over  the  expectation  value 
of  a  logarithmic  measurement  of  intensity.  For 
example,  if  the  parameter  to  be  estimated  is  the 
expected  intensity  level  (L),  as  is  often  the  case 
in  engineering  applications,  the  bound  is  depen¬ 
dent  only  on  the  number  of  coherence  cells  in  the 
average.  This  situation  is  desirable  in  comparing 
measurements  with  different  intensity  expectation 
values,  because  the  resolution  can  be  kept  constant. 
Conversely,  if  the  parameter  to  be  estimated  is  the 
intensity  expectation  value  a,  the  bound  is  directly 
dependent  on  both  the  number  of  coherence  cells  in 
the  average  and  the  local  expectation  value  of  inten¬ 
sity.  This  makes  comparison  of  measurements  with 
different  intensity  expectation  values  more  difficult, 
because  the  resolution  varies  in  direct  proportion  to 
the  parameter  to  be  estimated. 

The  minimum  error  possible  in  the  unbiased  position 
estimation  of  an  object  in  an  intensity  image  is  now  de¬ 
rived.  This  resolution  bound  is  also  a  bound  on  recog¬ 
nition  of  the  object  because  an  object  that  cannot  be 
resolved  cannot  be  recognized.  Let  the  intensity  mea¬ 
surements  T  [x  —  x0]  describe  an  object  measurement 
vector  tF  of  finite  length  X  and  unknown  position  Xq 
in  a  one-dimensional  image  W  of  spatial  pixel  index 
x  such  that  —X/2  <  x  -  xq  ^  X/2.  The  d'fx  —  xo] 
are  gamma  distributed  according  to  <g(('V\x  —  xo]),  /x), 
where  the  expectation  value  of  the  object  is  defined 
by  <¥[x  —  x0])  and  the  number  of  coherence  cells  in 
the  measurement  average  is  a  constant  /x  throughout 
the  object.  With  the  definition  q  [x  —  xo]  =  lnKjl'fx  — 
*o])/^ref)  and  Ax  as  a  pixel  increment,  the  logarithmic 
form  of  the  Fisher  information  given  in  Eq.  (4)  can  be 
used  to  yield  the  CRLB  for  estimation  of  the  position 
parameter  Xo-  This  Fisher  information  is 

j  =  JX_  fX/2  dq[x  -  Xq] 

Ax  Jx=-X/2  dx 

Defining  Q [ £]  as  the  Fourier  transform  of  e/[x], 

r  oo  rX! 2 

E  =  /  |Q[02df  =  /  I q[x  ~  x0]|2dx  (7) 

J  -oo  J -X/2 

as  the  energy,  and 

firms  -  ^  f  l  e\Qm\2 df  (8) 


as  the  rms  bandwidth  characterizing  the  natural  log  of 
the  expected  value  of  object  intensity,  yields  the  CRLB 
for  position  estimation  of  the  object: 

A  r 

E[(xo  -  xo)2]  >  J-1  =  p9  „  •  (9) 

P-Bfins  E 

This  result  and  the  development  from  relations  (6)- (9) 
are  analogous  to  those  used  in  bounding  time-delay 
resolution  for  radar  returns  in  uncorrelated 
noise.11  This  is  due  to  the  similar  form  of  the  Fisher 
information  matrix  in  both  problems.  However,  it 
must  be  stressed  that  in  this  case  Brms  and  E  are 
descriptors  of  the  log-transformed  object  expectation 
value,  which  can  span  a  full  range  of  values.  Also, 
the  noise  is  from  signal-dependent  fluctuations  that 
are  only  signal  independent  and  additive  in  the  loga¬ 
rithmic  domain,  whereas  in  the  radar/sonar  time-delay 
problem  similar  methods  are  used  to  describe  the  rms 
bandwidth  and  energy  of  a  coherent  waveform  (which 
also  can  span  a  full  range  of  values)  in  independent 
additive  white  noise.  With  these  definitions,  Fisher 
information  for  object  recognition  and  position  reso¬ 
lution  increases  with  the  number  of  coherence  cells 
and  (log-domain)  bandwidth  and  energy  and  decreases 
with  pixel  increment.  For  example,  it  is  apparent 
from  relations  (7)— (9)  that  occlusion  of  an  object  can 
decrease  the  energy  or  bandwidth  and  cause  the  Fisher 
information  to  decrease  and  the  CRLB  to  increase. 

The  matched  filter  estimator  has  been  shown  to 
attain  the  CRLB  for  position  resolution  of  a  signal 
in  independent  additive  white  noise  when  its  output 
SNR  is  high.2,11  For  example,  matched  filtering  an 
image  with  the  expected  object  in  the  logarithmic  do¬ 
main  provides  the  minimum  variance  unbiased  es¬ 
timator  for  object  localization  because  it  attains  the 
CRLB  of  relation  (9)  when  E  »  £(2,  /x) Ax,  where 
£(2,  /jl)  ~  1/ /A  always  holds  approximately  but  becomes 
more  accurate  as  /x  increases.  Furthermore,  the  out¬ 
put  of  such  a  log- transformed  matched  filter  always 
has  maximum  SNR.  One  can  see  this  by  first  defin¬ 
ing  the  log- transformed  object  measurement  <l>  such 
that  4>[x]  =  ln(''F[x]//ref)  and  then  employing  the  de¬ 
composition  cj>[x]  =  S[x]  +  jV[x],  where  the  signal  com¬ 
ponent  is  deterministic  and  defined  as  «S[x]  =  q[x\  + 
i/d/H  ~  In  /jl,  so  that  the  noise  component  ZV[x]  is  zero 
mean  and  exponential-gamma  distributed  according  to 
T<g((N[x])  =  0,  /jl).  The  linear  time-invariant  filter 
that  maximizes  the  output  SNR  for  such  zero-mean  un¬ 
correlated  noise  is  the  matched  filter.2  The  output  of 
the  matched  filter  for  the  log-transformed  image  is 

ka  f  *2 

R[l]  =  S[xMx  -  Z]dx  (10) 

Ax  JX=X1 

for  —X  <  Z  <  X,  where  S[x]  is  the  optimal  filter, 
the  noise  covariance  (AI[x]AI[x'])  is  £(2,  /jl)  for  x  =  x' 
and  zero  otherwise,  ko  is  a  normalization  constant, 
and  the  integration  is  only  over  the  overlap  of 
«S[x]  and  <h[x  -  Z].  The  output  SNR  is  defined 
as  SNR  (R[l  ])  s  <R[Z]>7«R[Z]2>  -  <R[Z]>2).  It 
has  a  maximum  value  at  zero-lag  SNR  (i?[0])  = 
Es/[£(2,  /u.)  Ax],  where  the  signal  energy  is  Es  =  J  -X/2 
|«S[x]|2dx.  The  signal  energy  is  approximated  by  E, 


2 

dx .  (6) 
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and  the  maximum  SNR  (R[0])  is  approximated  by 
/jlE / Ax  with  increasing  accuracy  as  p,  increases.  An 
optimal  logarithmic  matched  filter  for  the  special 
case  of  p  =  1  was  recently  derived  by  Downie  and 
Walkup.12  Their  filter  also  differs  from  that  above 
because  it  has  not  been  defined  so  that  the  additive 
noise  is  zero  mean. 

To  investigate  the  information  theory  perspective, 
the  conditional  probability  distribution  for  the  log- 
transformed  object  measurement  can  be  written  as 


R(‘l>|a)  = 
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by  straightforward  algebraic  manipulation  of  Eq.  (2), 
where  M  is  the  number  of  pixels  in  d>  and  p  is  constant 
over  x.  The  argument  of  the  interior  exponential  can 
be  expanded  into  a  Taylor  series6  such  that 


P(0> | a)  « 
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IV) 


I M 
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,  X/2 

x  exP  ~  “7T  X  _  <7[*;  al!2 
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for  |<b[x]  -  q[x;  a]|  «  3.  (This  can  be  a  reasonable 
approximation  even  for  p  =  1  because  the  correspond¬ 
ing  standard  deviation  of  <b[x]  is  then  tt-JG  ~  1.3.  As 
/x  increases,  the  approximation  becomes  better  and 
Stirling’s  formula  leads  to  a  Gaussian  density.6)  It  is 
assumed  that  there  is  a  priori  probability  TV)  that 
the  z'th  object  is  present  in  an  image,  where  W]) 
defines  the  z'th  object’s  expectation  value  such  that 
q„[x]  =  ln(W])//ref).  This  a  priori  probability  P{v ) 
should  be  set  by  the  context  of  the  recognition  prob¬ 
lem.  According  to  the  information  theory  of  Wood¬ 
ward  and  Davies,21*  the  ideal  or  a  posteriori  receiver 
for  the  z'th  object  is  one  that  computes  the  a  posteriori 
probability  P(z'|<l>)  =  P(z')P(<I>|z')/P(<I>),  where  P(4>)  is 
a  known  constant  fixed  by  the  measurement  <l>.  From 
relation  (12)  it  follows  that 
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where  the  general  parameter  set  a  is  replaced  by 
the  specific  object  index  v.  Because  the  <b[x]  are 
measured,  the  first  summation  term  in  the  exponent 
is  a  known  constant.  Following  the  analogous  radar 
problem,  it  is  common  to  assume  that  the  qv\x\  have  the 
same  energy  over  zq2,13  so  that  the  second  summation  is 
a  constant.  Therefore  the  correlation  receiver  of  the 
log-transformed  intensities 


u  rxl2 

C(z')  =  - —  /  d>[x]q,,[x]dx  (14) 

Ax  Jx=-XI 2 

is  a  sufficient  statistic2,8-10,13  from  which  the 
a  posteriori  density  PM®)  may  be  fully  recon¬ 
structed  and  all  the  received  information  about  the 
presence  of  the  z'th  object  may  be  fully  recovered  in 
an  optimum  receiver.2,13  Clearly,  there  is  a  simple 
linear  relationship  between  the  correlation  receiver 
C(z')  and  the  zero-lag  value  of  the  optimal  filter  output 
P[0],  which  involves  known  additive  and  multiplicative 
constants.  For  example,  when  P(z')  is  uniformly 
distributed,  C(z')  attains  a  maximum  with  respect  to  v 
for  the  object  that  is  most  likely  to  be  present. 

The  a  posteriori  probability  P(z'|1R)  for  the  presence 
of  the  z'th  object  given  the  intensity  measurement  d* 
is  equal  to  the  a  posteriori  probability  P( z' |<I>)  given 
the  log  measurement  <I>,  because  <l>  is  completely 
specified  by  'I'  and  vice  versa.  However,  the  sufficient 
statistic  of  Eq.  (14),  the  optimal  filter  of  Eq.  (10), 
and  the  Fisher  information  of  Eq.  (9)  indicate  that 
matched  filtering  images  with  hypothetical  patterns 
in  the  logarithmic  domain  provides  an  optimal  method 
for  pattern  recognition  in  the  presence  of  signal- 
dependent  noise  arising  from  CCGR  fluctuations  in  the 
received  fields.  Because  CCGR  fields  are  commonly 
measured  in  optical,  radar,  and  acoustic  imaging,  this 
result  provides  a  mathematical  justification  for  the  use 
of  logarithmic  intensity  measurements  to  efficiently 
convey  information  for  pattern  recognition  in  a  variety 
of  engineering  applications.  These  results  may  also 
be  useful  in  interpreting  the  apparent  logarithmic 
response  of  human  auditory  and  visual  perception  to 
intensity  stimulus  as  exhibited  in  the  Weber-Fechner 
laws.14 
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